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INTRODUCTION 


Breast  palpation  by  clinicians  is  an  effective  examination  frequently  performed  for  breast  cancer  detection  and  treatment 
monitoring.  The  utilization  of  physical  breast  examination  however  has  been  hampered  by  its  inherent  subjective  nature 
leading  to  (1)  the  difficulty  in  interpreting  the  examiner’s  impressions  of  the  perceived  lump  in  the  breast  and  (2)  the 
difficulty  in  documenting  tactile  characteristics  of  the  tumor  for  subsequent  examinations  or  monitoring.  The  primary 
objective  of  the  Task  I  is  to  adapt  new  tactile  sensing  technologies  to  the  needs  of  improving  physical  breast  examination 
and  gather  preliminary  data  regarding  potential  clinical  applications.  A  novel  and  effective  tactile  mapping  device  (TMD) 
has  been  developed  to  quantitatively  characterize  breast  cancer  through  breast  palpation  so  as  to  demonstrate  the 
feasibilit}'  and  effectiveness  of  the  TMD  to  the  three  specific  applications:  diagnosis,  documentation,  and  training. 
Limited  laboratory  experimental  evaluation  has  been  conducted  to  collect  preliminary  data  that  will  permit  formation  of  a 
full-scale  Task  II  research  plan.  Our  considerable  efforts  in  the  Task  I  are 

•  Transfer  and  adapt  the  existing  tactile  sensor  array  and  force  measurement  technologies  for  robotics  application  to 
medical  sensing  application. 

•  Modify  the  design  specifications  of  tactile  sensor  array  construction  for  the  specific  application  of  TMD  in  breast 
palpation. 

•  Apply  TMD  to  various  educational  breast  models  and  in-house  phantoms  (with  various  lumps  within  the  models) 
to  collect  sufficient  tactile  images. 
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BODY 


Following  the  tasked  research  plan,  the  development  of  a  prototype 
TMD  comprised  mainly  of  a  tactile  sensor  array  probe  (TSAP) 
[7,15,30],  a  3D  camera  [6,9],  a  6  degree-of-ffeedom  (DOF) 
force/torque  sensor  [7,14,33],  and  a  graphical  user  interface  [7],  which 
can  provide  the  means  to  produce  tactile  maps  of  the  detected  breast 
lumps  during  a  breast  palpation.  Focusing  on  the  key  tactile  topology 
features  from  breast  palpation  such  as  spatial  location,  size  and  shape  of 
the  detected  lesion,  and  the  force  levels  used  to  demonstrate  the 
palpable  abnormalities,  these  maps  can  record  the  results  of  clinical 
physical  breast  examination  with  a  set  of  pressure  distribution  profiles 
(i.e.,  images)  due  to  detected  lesion  and  the  force  sensor  measurements 
corresponding  to  the  applied  force  levels.  These  maps  will  serve  as  an 
objective  documentation  of  palpable  lesions  for  subsequent 
examinations  and/or  follow-up  treatment  assessment.  Using  advanced 
signal  processing  techniques,  these  maps  will  also  provide  new 
information  for  characterization  of  tumor  biomechanics  [8,18], 
Preliminary  results  of  simulated  experiments  of  the  TMD  prototype 
have  pilot-tested  our  hypothesis  and  provided  solid  promising  data 
showing  the  feasibility  of  the  TMD  in  real  clinical  applications  [7,8,9], 

We  have  conducted  a  systematic  study  to  adapt  new  tactile  sensing 
technologies  to  the  needs  of  improving  physical  breast  examination,  to 
gather  preliminary  data  regarding  potential  clinical  applications,  and  to 
advance  fundamental  understanding  of  palpation.  Using  the  prototype 
TMD,  we  have  measured  three  key  variables  during  palpation:  the 
examiner’s  search  patterns,  the  applied  forces,  and  the  small-scale 
pressure  variations  at  the  skin  due  to  lumps,  and  have  conducted 
intensive  experimental  studies  evaluate  its  performance.  The  primary 
objective  aims  that  (1)  new  tactile  mapping  technology  can 
quantitatively  measure  the  location  and  applied  forces  in  breast 
palpation,  and  the  tactile  features  of  detected  breast  lumps;  and  (2)  new 
device  can  accurately  characterize  and  document  breast  lumps  and  will 
improve  clinicians’  ability  to  monitor  changes  in  lump  across  time.  We 
have  also  calibrated  and  pilot  tested  the  prototype  TMD  through 
laboratory  experiments  to  evaluate  TMD’s  performance  in  terms  of 
reliability,  validity,  and  safety.  Our  experiment  has  shown  that  this 
novel  TMD  system  can  make  it  possible  to  quantitatively  and 
objectively  record  and  characterize  the  processes  and  findings  of  breast 
palpation. 


System  Overview 

The  goal  of  this  prototype  TMD  system  is  to  extend  the  range  and  resolution  of  breast  palpation  methods,  thus  increasing 
palpation  sensitivity  and  specificity  (i.e,  the  ability  to  detect  and  characterize  lumps  and  quantify  clinically  significant 
changes).  Using  3D  camera,  force  sensor,  and  tactile  sensor  arrays,  we  can  create  reproducible  tactile  maps  (or  images)  of 
the  palpable  abnormalities  in  the  breast.  With  various  sizes  and  resolution  of  the  tactile  sensor  arrays,  the  TMD  can  record 
the  multi-foci  spatial  distribution  of  the  detected  lumps  and  the  higher  resolution  tactile  images  of  a  particular  lump. 

(J 

Our  prototype  TMD  system  incorporates  a  3D  Rainbow  camera,  a  tactile  sensor  array  probe  (TSAP),  a  breast  model  with 
simulated  lumps,  a  6DOF  force/torque  sensor  on  which  the  breast  model  is  mounted,  and  a  graphical  user  interface  (GUI). 
Figure  2  shows  a  block  diagram  of  the  prototype  tactile  mapping  device  system  being  developed  for  measurement  and 
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characterization  of  palpable  abnormalities  in  the  breast  in  a  laboratory  setting  and  later  in  pre-clinical  trial.  In  a  typical 
task,  upon  detecting  a  suspicious  lump  with  a  lower  tactile  perception  threshold,  the  examiner  will  bring  the  TSAP  into 
contact  with  the  tissue  at  the  palpation  site.  For  a  thorough  tactile  mapping  procedure,  this  involves  3D  positioning  the 
probe  through  the  camera  facing  the  site.  The  resulting  pressure  distribution  across  the  probe  surface  is  measured  by  a 
tactile  sensor  array  with  associated  readout  electronics.  Multiple  tactile  images  with  various  applied  force  levels  and 
torque  angles  will  be  required  for  an  accurate  lesion  characterization.  A  computer  will  process  and  control  the  signals  to 
generate  appropriate  output  for  visual  display  on  a  monitor  as  an  interactive  feedback  to  the  on-line  users  or  the  raw  data 
to  the  physician’s  office  through  a  telecommunication  channel.  This  prototype  TMD  system  was  successfully  developed 
and  has  been  working  effectively  and  reliably  in  our  research  site.  Through  extensive  testing  and  physician's  inspection 
(by  Dr.  Matthew  Freedman),  we  believe  that  our  prototype  TMD  has  fully  achieved  the  design  objective  [7].  Below,  we 
describe  the  components  of  the  TMD  prototype  in  detail. 


Visual 


3D  Rainbow 


Figure  2.  System  block  diagram  of  prototype  TMD. 


3D  Rainbow  Camera 


Figure  3, 3D  range  imaging  of  palpation  tracking  by  the  Rainbow  camera. 

For  the  accurate  positioning  of  the  TSAP  with  the  purpose  of  tumor  localization,  a  novel  3D  rainbow  camera  is  adopted  in 
our  system,  which  is  suitable  for  this  high-speed  3D  machine  vision  application.  Figure  3  shows  the  rainbow  camera 
acquired  sample  3D  range  image  of  breast  palpation  procedure,  where  the  examiner's  hand/fmgers,  TSAP,  and  breast 
profile  are  clearly  identified.  It  exploits  a  color  light  projector  to  illuminate  the  object  in  the  scene  and  using  an  off-the- 
shelve  color  camera  to  obtain  a  full-frame  color  image  of  the  scene.  The  color  of  the  projecting  light  with  spatially 
continuously  varying  wavelength  is  encoded  with  information  of  the  corresponding  projection  angle.  Each  pixel  of  the 
color  image  is  associated  with  a  unique  ray  through  the  focal  point  of  the  camera.  Since  the  angle  between  camera  axis 
and  the  ray  is  known,  the  resulting  angle-side-angle  triangulation  problem  can  be  precisely  solved  when  the  distance 
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between  the  light  projector  and  the  camera  is  fixed.  Thus,  using  only  one  camera,  the  full  frames  of  3D  range  images  can 
be  obtained  directly  at  the  camera  frame  rate  (60  frames/s).  We  have  performed  experiments  to  investigate  the  actual 
range  accuracy  and  the  major  error  contributors.  The  results  show  that  the  3D  profiles  of  test  artifacts  were  less  than  1 
mm.  The  spatial  resolution  of  the  system  is  limited  only  by  the  spatial  resolution  of  the  camera  optical  sensing  element 
and  is  currently  able  to  provide  at  least  1024x1024  pixel  resolution.  When  a  palpation  site  is  determined,  multiple  3D 
range  images  will  be  acquired  to  record  the  site  information  [6,9]. 

Tactile  Sensor  Array  Probe  (TSAP) 

The  core  component  of  the  TMD  is  a  high  sensitive  tactile  sensor  array  probe.  A  signal  acquisition  and  processing  unit 
with  specifically  designed  software  and  hardware  components  have  been  developed  to  generate  high  signal-to-noise  ratio 
tactile  readout  images.  Though  many  other  t5q)es  of  tactile  sensors  are  available,  we  have  decided  to  use  a  capacitive 
tactile  sensor  in  this  application  since  it  has  been  well  tested  in  surgical  applications  such  as  minimally  invasive  surgery 
and  is  the  state-of-the-art  technology  in  this  domain  [14,17,28,19].  The  actual  tactile  sensor  array  with  the  copper  layers 
and  the  silicone  rubber  spacers,  which  is  based  on  the  state-of-the-art  design  by  our  consultant  Fearing  [15,30,34]  and 
former  collaborator  Howe  [17,28].  The  array  is  composed  of  two  crossed  layers  of  copper  strips  separated  by  thin  strips  of 
silicone  rubber  [15,17].  Each  crossing  area  forms  a  capacitor,  and  when  a  force  is  applied  onto  where  the  strips  cross,  the 
distance  between  the  strips  decreases  and  the  capacitance  increases  [28,30].  Specially  designed  electronics  will  measure 
the  capacitance  of  each  element  and  relate  the  capacitance  change  to  the  force  applied  to  each  element.  By  measuring  the 
capacitance  variations  from  all  the  elements  simultaneously,  we  can  determine  the  spatial  distribution  of  pressure  across 
the  sensor  array.  The  sensor  array  is  made  with  an  inexpensive  photolithography  and  an  etching  process  and  can  be  easily 
attached  to  a  variety  of  probe  shapes.  In  this  prototype  specification,  it  is  composed  of  an  eight  by  eight-tactile  sensor 
array  with  elements  that  are  4  mm  on  a  side.  The  sensor  is  mounted  on  a  plastic  brass  backing  plate  with  a  surface  that  has 
been  machined  into  a  section  of  a  square.  The  backing  plate  is  5.08  cm  on  a  side  and  the  effective  sensing  area  is  3.20  cm 
on  a  side.  We  decided  to  make  the  sensor  flat  in  order  to  minimize  inhomogeneity  because  the  resulting  pressure 
distribution  should  have  a  uniform  overall  signal  to  noise  ratio.  The  tactile  images  will  then  be  consistent  when  used  for 
various  breast/chest  background  textures.  Other  shapes  of  the  TSAP  are  undergoing  investigation.  The  actual  spatial 
resolution  of  the  tactile  sensor  array  is  4  mm  long  where  the  smallest  masses  that  we  are  currently  interested  to 
characterize  are  on  the  order  of  1  cm  in  diameter.  Smaller  elements  would  increase  spatial  resolution  at  the  cost  of  lower 
coverage  area  and  low  sensitivity  since  the  capacitance  is  proportional  to  the  element  area  [28,30].  The  tactile  sensor  has 
been  shielded  to  provide  electronic  insulation. 

Force/Torque  Sensing  System 

The  relationship  between  the  hard  inclusion  (i.e.,  lump)  and  the  perceived  tactile  image  from  the  TSAP  is  nonlinear  and 
complex.  In  order  to  characterize  and  later  extract  the  tactile  features  of  the  detected  breast  lumps,  the  TMD  operation 
requires  that  the  force/torque  levels  exerted  by  the  operator  on  the  breast  model  be  measured  together  with  the 
corresponding  tactile  images.  It  would  be  ideal  if  a  force/torque  sensor  were  to  be  mounted  between  the  wrist  and  the 
hand  of  the  operator.  Since  it  may  be  problematic  and  impractical  to  mount  a  force/torque  sensor  in  such  a  configuration 
for  the  prototype  system,  we  decided  to  mount  it  under  a  base,  which  the  breast  model  is  placed  on.  The  force/torque 
levels  acquired  by  the  sensor  in  this  configuration  can  be  transformed  to  those  exerted  by  the  operator  via  proper 
coordinate  transformation  where  the  applied  forces  and  angles  are  two  important  parameters.  The  JR^  force/torque  sensor 
mainly  consists  of  a  JR^  monolithic  six  DOF  force  sensor  and  a  JR^  Intelligent  Support  System™,  comprised  of  boards  for 
signal  conditioning,  data  acquisition  and  processing.  A  computer  program  was  written  in  Visual  to  send  control 
command  to  request  the  JR^  force/torque  sensing  unit  to  send  the  measurement  values  to  the  computer  including  six 
force/torque  levels  and  the  Cartesian  x-,  y-,  r-axes  assigned  to  the  base.  The  transmitting  and  receiving  of  data  between  the 
computer  and  the  force/torque  system  is  carried  out  through  serial  port.  We  have  conducted  laboratory  experiments  to 
evaluate  the  sensitivity  of  the  force/torque  system.  The  preliminary  data  indicated  that  the  force  measurement  sensitivity  is 
±  0.01  lb  with  a  maximum  value  of  5  lb.  Through  physician’s  pre-clinical  trials  (by  Dr.  Matthew  Freedman),  the 
sensitivity  and  maximum  load  are  suitable  to  the  desired  task. 
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Breast  Models 


The  breast  models  used  in  our  laboratory  experiments  were  provided  by  the  HEALTH 
EDCO,  a  Division  of  WRS  Group,  Inc.  and  the  Mammatech,  Co.  The  models  were  made 
from  BIOLIKE™  synthetic  tissue  that  feels  just  like  a  real  breast  [13,25].  Two  models  were 
used  in  our  tests  to  collect  preliminary  data.  Each  of  them  has  5  lumps  that  simulate  easy- 
and  hard-to-find  breast  tumors  with  various  sizes  and  depths  at  different  locations.  One  of 
the  models  is  the  geriatric  breast  that  is  ideally  shaped  to  address  the  special  problems  of 
older  women.  The  geriatric  model  simulates  the  natural  stretching  of  the  tissue  with  age. 
Figure  4- shows  the  breast  model  and  the  distribution  of  simulated  lumps  (lesions)  in  the 
breast  model  respectively.  Physician's  inspections  have  shown  that  the  breast  models  are 
well  suitable  for  laboratory  experiment  to  gather  preliminary  data.  It  should  be  noticed  that 
as  high  as  50%  of  breast  cancers  occur  at  the  axilia  area  which  is  difficult  to  imaging. 


Graphical  User  Interface 


Figure  5.  Graphical  user  interface  (GUI)  of  the  TMD  prototype  including  6DOF  force/torque 
feedback  (up-left),  tactile  imaging  control  menu  (up-right),  visual  display  of  pressure  distribution 
(down-left),  and  3D  mesh  and  contour  map  based  localization  (down-right). 

For  both  tactile  documentation  and  interactive  training,  a  graphical  user  interface  (GUI)  plays  a  very  important  role  of 
optimizing  both  machine  and  examiner’s  performance.  Since  such  kind  of  GUI  has  not  been  available  previously,  we  have 
put  considerable  effort  to  develop  this  function.  The  difficult  issue  here  is  that  the  GUI  needs  to  integrate  three  different 
functions  (tactile  sensing,  force  sensing,  and  visual  display,  which  were  previously  developed  in  different  platform  (DOS 
and  Window95),  and  language  (C^^,  Assembly,  and  Matlab).  In  our  prototype  system,  Microsoft  Visual  was  employed 
to  implement  the  GUI  to  visually  display  pertinent  data  of  the  TSAP  and  the  force/torque  sensor.  Figure  5  shows  the 
output  window  of  the  GUI  that  presents  on-line  the  pressure  distribution  acquired  by  the  TSAP,  the  time  response  of  the 
six  DOF  force/torque  applied  by  the  examiner.  The  user  can  use  mouse  to  interact  with  the  TMD  functions  through  the 
specifically  designed  menu. 
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Applications  in  Documentation 


Using  the  prototype  TMD,  we  have 
generated  various  tactile  images  of  the 
detected  breast  lumps  as  an  objective 
electronic  document  for  lesion 
characterization  in  subsequent 
examinations.  We  have  evaluated  the 
performance  of  the  TMD  in  this 
application  in  terms  of  reproducibility  for 
subsequent  exams  and  for  different  users 
regarding  key  tactile  features  such  as 
pressure  profiles  and  applied  forces.  The 
preliminary  data  have  clearly  shown  the 
effectiveness  and  feasibility  of  tactile 
mapping  in  understanding  and  improving 
physical  breast  examinations  for  breast 
cancer  diagnosis.  Through  statistical  data 
analysis  and  physician’s  pre-clinical 
inspection,  the  reproducibility,  sensitivity, 
and  specificity  were  very  satisfactory. 

In  order  to  demonstrate  the  effectiveness 
of  the  TMD  system  for  the 
characterization  and  documentation  of 
detected  lumps,  intensive  experiments 
have  been  conducted  to  pilot-test  the  sensitivity  and  reproducibility  of  the  system  in  measuring  the  applied  forces  and  the 
pressure  profiles  due  to  lumps.  The  primary  objective  here  is  to  quantitatively  acquire  tactile  measurements  of  the 
perceived  lesions  using  the  TMD  system  and  to  evaluate  the  performance  of  the  system.  In  a  t5q)ical  experiment  described 
below,  the  force/torque  levels  applied  by  the  human  examiner  during  palpation  process  are  recorded  in  terms  of  six 
force/torque  parameter  values,  i.e.,  Fx,  Fy,  Fz,  Mx,  My,  Mz.  For  the  tactile  imaging  of  simulated  lesions,  the  TSAP  is 
used  to  acquire  various  tactile  images  by  palpating  the  site  after  the  examiner  locates  the  lesion  by  initial  hand  palpation 
with  lower  tactile  perception  threshold.  Since  the  relationships  between  the  tactile  images  and  lesion  characteristics  are 
expected  to  be  complex  and  nonlinear,  we  believe  that  the  inverse  problem  (extraction  of  lesion  characteristics  from 
tactile  images)  can  be  solved  when  sufficient  tactile  information  is  acquired.  As  a  result,  for  each  of  the  lesions,  after 
pushing  the  TSAP  against  the  breast  to  achieve  certain  level  of  force,  the  examiner  rotates  the  TSAP  to  five  different 
orientations  at  each  of  which  the  information  about  the  force/torque  levels  and  tactile  image  are  simultaneously  recorded. 
ORl  is  the  initial  orientation  of  the  TSAP  after  being  pushed  by  the  examiner  to  certain  level  of  force.  OR2,  OR3,  OR4 
and  OR5  are  the  TSAP  orientations  after  it  is  rotated  forward,  backward,  left  and  right,  respectively. 

We  have  carried  out  the  above  procedure  on  a  total  of  10  simulated  lesions  within  two  types  of  breast  models  with  each  of 
them  containing  five  lesion  clusters  numbered  from  1  to  5.  Our  experience  has  indicated  that  the  TMD  had  a  high 
sensitivity  for  the  detection  of  lesions  #1,  #4,  and  #5,  while  had  a  difficulty  to  detect  lesions  #2  and  #3  confidently.  We 
believe  that  these  data  has  also  supported  the  TMD’s  complementary  role  to  the  mammography.  Therefore,  by  focusing 
on  those  suitable  lesions,  a  total  of  six  sets  of  tactile  maps  have  been  generated  with  each  of  them  containing  five  tactile 
images.  Figure  6  shows  several  typical  tactile  images  where  two  representative  lesions  (#1  and  #4)  were  studied.  A 
shading  interpolation  of  the  pressure  distribution  measured  by  the  TSAP  has  been  employed  to  achieve  better  visual 
perception.  These  tactile  images  have  for  the  first  time  quantitatively  displayed  the  tactile  features  of  the  lumps  during 
breast  palpation. 


Figure  6.  Multiple  views  of  the  tactile  images  of  the  detected  breast  lumps,  using  the 
TMD  with  different  angles  and  applied  forces. 
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Lesion 

TSAP 

Orientation 

6DOF  Force  &  Torque  (Ib/inlb) 

Fx 

Fy 

Fz 

Mx 

My 

Mz 

1 

ORl 

0.44 

-2.58 

-10.80 

0.50 

OR2 

-2.34 

2.50 

-0.10 

-5.26 

-22.02 

1.59 

OR3 

1.69 

2.96 

-2.28 

3.57 

OR4 

3.20 

-0.38 

0.40 

2.09 

OR5 

-1.83 

0.38 

iiiiiiiiBiQgiiim 

-2.38 

-9.32 

1.99 

4 

ORl 

-3.17 

1.77 

-0.16 

5.85 

25.59 

-0.89 

-2.08 

2.48 

-0.22 

4.37 

18.35 

1.78 

OR3 

-8.81 

-0.03 

-0.09 

1.98 

10.71 

0.20 

OR4 

-1.72 

0.00 

2.18 

10.01 

0.39 

OR5 

-4.77 

4.02 

-0.34 

10.81 

3.97 

The  above  table  summarized  the  values  of  force/torque  levels  recorded  from  the  experiments  that  were  conducted  to  map 
the  Lesions  #1  and  #4.  Before  conducting  the  experiment  on  Lesion  #1  and  Lesion  #4,  we  apply  the  same  procedure  on  a 
location  at  which  there  exists  no  lesion,  as  the  fully  controlled  cases.  The  resulting  display  shows  no  peak.  Examining 
the  graphical  displays  in  Figure  6,  in  comparison  with  that  of  the  case  of  no  lesion,  we  noticed  that  pressure  peaks 
consistently  occur  in  the  display  and  a  peak  in  the  graphical  display  indicates  the  existence  of  a  corresponding  lesion.  Our 
experience  has  also  shown  that  there  is  a  trade-off  between  the  actual  spatial  resolution  and  the  signal-to-noise  ratio 
(SNR).  Thus,  further  optimization  of  the  TSAP  is  needed  and  should  be  under  the  guidance  of  experimental  data  showing 
the  best  tactile  characterization  of  various  lumps.  In  addition,  the  force  and  torque  levels  that  we  recorded  in  conjunction 
with  the  tactile  sensing  during  palpation  will  provide  us  the  information  about  the  contact  location  and  how  much  force 
that  we  apply  on  the  hard  lump  in  the  breast  model.  We  have  repeatedly  conducted  documentation  experiments  at 
different  times,  applied  to  different  lesions,  and  by  different  users  in  the  past  six  months.  Our  intensive  results  have 
consistently  shown  the  excellent  reproducibility  of  the  prototype  TMD  where  the  mean  squared  error  (MSE)  was  used  to 
measure  the  different  between  two  tactile  images  acquired  by  the  TMD  for  two  identical  settings.  Preliminary  statistical 
analysis  also  indicated  the  variance  of  the  experimental  data  (tactile  profile,  force,  and  3D  location)  is  small. 

Applications  in  Training 

We  have  studied  the  feasibility  of  TMD  for  training  of  examiners  in  performing  physical  breast  examination,  through  the 
integration  of  a  computerized  interactive  training  system,  with  the  purpose  of  improving  the  trainees’  ability  in  how  best 
to  search  palpable  abnormalities  with  optimal  forces  in  detecting  smaller  tumors.  More  specifically,  3D  range  imaging 
will  track  the  hand  motion  and  calculate  the  total  coverage  of  the  palpation,  and  6DOF  force/torque  sensor  will  measure 
the  applied  forces  and  directions.  The  GUI  will  provide  the  trainee  a  visual  feedback  of  those  measured  parameters  so  that 
this  interactive  training  program  can  help  the  trainee  to  understand  the  principal  of  breast  palpation  and  adjust^improve 
his/her  skills. 

We  have  developed  a  vision-based  finger  motion  tracking  technique  to  gather  spatial  finger-position  related  data  and  have 
pilot  tested  this  prototype  system  for  breast  palpation  training  using  this  technique  [9].  By  tracking  the  position  of  the 
fingers,  the  system  can  provide  first-hand  quantitative  data  about  the  search  patterns  of  the  palpation  process.  By 
displaying  position  information  in  real  time  as  the  palpation  is  performed,  the  system  can  provide  for  the  first  time  the 
feedback  so  that  the  trainee  can  self  check  his/her  search  strategy  and  instantly  know  which  areas  have  been  covered. 
While  other  object  tracking  techniques  (e.g.,  magnetic  or  acoustic)  have  been  proposed,  vision-based  tracking  is 
considered  to  be  the  most  appropriate  to  our  task  because  it  is  the  least  obstructive  and  expensive  method.  Using  our  3D 
range  camera,  we  have  adopted  a  model-based  approach  in  which  a  3D  model  of  a  generic  human  hand  were  employed 
and  fitted  to  the  specific  hand  shape  of  the  user  for  tracking  hand  motion.  In  order  to  reduce  the  complexity  of  the 
approach,  we  have  developed  a  color-assisted  finger  tracking  step  which  tracks  the  2D  spatial  positions  of  the  three 
colored  palpation  fingernails  during  the  training  procedure.  Color  transform  is  utilized  to  extract  color  features  instead  of 
directly  using  the  RGB  values.  Normalization  of  color  attributes  is  used  to  tackle  the  problem  of  potential  minor  ambient 
lighting  variations. 
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We  have  implemented  a  prototype  palpation-training  program  based  on  the  proposed  finger  tracking  and  force/torque 
sensing  approach.  A  small-scale  database  has  been  collected  from  the  recorded  expert’s  palpation  experience.  Three 
parameters  of  visual  feedback  are  provided  to  the  trainee:  (1)  search  pattern,  (2)  applied  force  level,  and  (3)  coverage  area. 
The  system  has  been  tested  in  a  laboratory  setting.  The  preliminary  experimental  results  have  proven  reliable  and  accurate 
performance  in  tracking  finger  positions  in  3D  and  the  corresponding  applied  force  levels. 

A  major  portion  of  the  work  was  reported  in  our  recent  manuscript  submitted  to  the  VACETS  Technical 
International  Conference  [Attached]. 

KEY  RESEARCH  ACCOMPLISHMENTS 


Our  key  research  of  the  Task  I  is  to  develop  a  TMD  with  various  resolutions  and  sizes  to  quantitatively  document  the 
locations  and  extract  the  tactile  features  of  the  detected  breast  lumps.  Our  accomplishments  in  the  Task  I  are  the  following 

•  Prototype  System  Development.  We  have  developed,  calibrated,  and  pilot  tested  a  novel  TMD  by  integrating 
state-of-the-art  tactile  pressure  sensor,  force/torque  sensor,  and  3D  visual  tracking  technologies,  and  conducted 
laboratory  experiments  and  limited  pre-clinical  trial  to  evaluate  TMD’s  performance  in  terms  of  reliability, 
validity,  and  safety. 

•  Application  in  Documentation:  We  have  applied  TMD  to  generate  the  tactile  images  of  the  detected  breast  lumps 
for  a  quantitative  and  objectively  characterization  of  breast  cancers  in  subsequent  examinations,  and  evaluated 
TMD’s  performance  in  improving  diagnosis  in  terms  of  reproducibility,  sensitivity,  and  specificity  for  different 
cases/users/exams. 

•  Application  in  Training:  We  have  studied  the  feasibility  of  TMD  for  training  of  examiners  in  performing  physical 
breast  examination,  through  the  integration  of  a  computerized  interactive  training  system,  with  the  purpose  of 
improving  the  trainees’  ability  in  how  best  to  search  palpable  abnormalities  with  optimal  forces  in  detecting 
smaller  tumors. 

REPORTABLE  OUTCOMES 


•  Research  training  under  Dr.  Robert  Wagner  supervision  at  Center  of  Devices  and  Radiological  Health  (FDA). 
Evaluating  diagnosis  performance  and  uncertainty  of  mutimodalities  using  Receiver  Operating  Characteristics 
(ROC)  analysis  without  knowing  the  truth. 

•  Non-Rigid  Image  Registration  by  Neural  Computations,  R.  Srikanchana,  K.  Woods,  J.  Xuan,  C.  Nguyen,  and  Y. 
Wang,  Proceedings  of  IEEE  Neural  Networks  for  Signal  Processing,  200 1 . 

•  Tactile  Mapping  of  Palpable  for  Breast  Cancer  Diagnosis,  R.  Srikanchana,  C.  Nguyen,  and  Y.  Wang,  VACETS 
Technical  International  Conference,  2001. 

•  Presented  the  paper  “Non-Rigid  Image  Registration  by  Neural  Computations”,  Conference  of  IEEE  Neural 
Networks  for  Signal  Processing,  Falmouth,  MA,  September  2001. 

CONCLUSIONS 


Through  the  Task  I  research,  the  results  have  fully  demonstrated  the  feasibility  of  the  TMD  for  improving  breast 
examination  technique  in  diagnosis,  documentation,  and  training.  In  particular,  the  results  have  shown  that  new  tactile 
mapping  technology  can  quantitatively  measure  the  location  and  applied  forces  in  breast  palpation,  and  the  tactile  features 
of  detected  breast  lumps;  the  prototype  interactive  training  program  can  track  finger  motions  and  applied  forces  during 
breast  palpation  in  which  the  on-line  feedback  can  help  the  training  to  better  understand  the  search  strategy  and  adjust 
applied  force  level  to  increase  the  sensitivity. 
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In  addition  to  the  demonstration  of  feasibility  for  planning  the  Task  II  project,  this  research  has  also  enable  many  further 
applications  for  tactile  mapping  in  breast  cancer  diagnosis  and  treatment.  The  tactile  lesion  characterization  effort  will 
contribute  to  our  fundamental  understanding  of  the  mechanical  interactions  in  palpation,  so  that  optimal  sensors  and 
palpation  strategies  can  be  developed.  By  knowing  the  advantages  and  limitations  of  the  sensors  and  the  associated 
algorithms  with  respect  to  the  detection  capability  and  accuracy  for  deeper  or  smaller  lesions,  the  clinical  applications  can 
be  better  defined. 
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Figure  2:  Prostate  Model  used  in  registration  (left:  reference  model;  middle:  float 
image;  right:  registration  cancer  class  of  float  image  to  reference  image  using  FMR 
method) 
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TACTILE  MAPPING  OF  PALPABLE  FOR  BREAST  CANCER  DIAGNOSIS 

Rujirutana  Srikanchana,  Charles  C.  Nguyen,  and  Yue  Wang 


Department  of  Electrical  Engineering  and  Computer  Science 
The  Catholic  University  of  America 
Washington,  DC 


Abstract:  This  paper  presents  the  development  of  a  prototype  Tactile  Mapping 
Device  (TMD)  system  comprised  mainiy  of  a  tactiie  sensor  array  probe  (TSAP),  a  3D 
camera  and  a  force/torque  sensor,  which  can  provide  the  means  to  produce  tactile 
maps  of  the  breast  lumps  during  a  breast  palpation.  Focusing  on  the  key  tactiie 
topology  features  from  breast  palpation  such  as  spatial  location,  size  and  shape  of 
the  detected  lesion,  and  the  force  leveis  used  to  demonstrate  the  paipable 
abnormalities,  these  maps  can  record  the  resuits  of  ciinical  breast  examination  with  a 
set  of  pressure  distribution  profiles  and  force  sensor  measurements  due  to  detected 
lesion.  By  combining  the  knowledge  of  vision  based,  neurai  networks  and  tactile 
sensing  technology  are  integrated  for  the  investigation  of  soft  tissue  interaction  with 
tactile/force  sensor,  where  the  hard  inclusion  (breast  cancer)  can  be  characterized 
through  neural  network  learning  capability,  instead  of  using  simplified  complex 
biomechanics  modei  with  many  heuristic  assumptions.  These  maps  wiil  serve  as  an 
objective  documentation  of  palpabie  iesions  for  future  comparative  examinations. 
Preiiminary  results  of  simulated  experiments  and  limited  pre-clinicai  evaluations  of 
the  TMD  prototype  have  pilot-tested  our  hypothesis  and  provided  solid  promising 
data  showing  the  feasibility  of  the  TMD  in  real  clinical  applications. 

1.  Introduction 

Physical  breast  examination  is  an  effective  and  completely  non-invasive  method  for 
the  detection  of  breast  cancer  [1-2].  With  a  lump^'as  the  most  common  symptom  of 
breast  cancer,  studies  show  that  the  majority  of  breast  cancers  was  found  by 
palpation  which  complements  mammography,  since  palpation  can  evaluate  breast 
tissue  near  the  chest  wall  and  axilia  that  is  not  accessible  to  mammography  [2].  In 
addition,  studies  have  found  that  as  many  as  12-15%  of  cancers  that  were  detected 
by  physical  examination  were  not  apparent  on  mammograms  [1-2]. 

Unfortunately,  breast  palpation  has  been  hampered  by  problems  inherent  in  its 
subjective  nature,  leading  to  difficulty  in  interpreting  and  documenting  the  examiner’s 
impressions  of  the  perceived  lump  in  terms  of  tumor  characteristics  [2].  For  example, 
a  physician  may  detemiine  that  a  palpable  suspicious  abnormality  needs  continued 
monitoring.  This  requires  maintaining  a  record  of  the  examination  results,  which  at 
present  is  limited  to  verbal  notes  about  parameters  such  as  the  position,  size,  and 
hardness  of  the  lump.  Because  it  is  difficult  to  verbalize  tactile  sensations,  the 
subjective  and  arbitrary  nature  of  these  notes  makes  effective  follow-up  exams 
problematic. 

We  have  conducted  a  study  to  advance  fundamental  understanding  of  palpation  and 
solve  these  practical  problems  through  the  creation  of  a  new  tactile  mapping  device 
(TMD).  This  device  will  measure  three  key  variables  during  palpation:  the  examiner’s 
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search  patterns,  the  applied  forces,  and  the  small-scale  pressure  variations  at  the 
skin  due  to  lumps.  We  have  integrated  and  pilot-tested  a  prototype  TMD  consisting  of 
a  novel  three-dimensional  (3-D)  camera  that  can  track  finger  motion  and  breast 
deformation  in  video  speed,  a  six  degree-of-freedom  (DOF)  force/torque  sensing 
device  measuring  the  applied  forces,  and  a  novel  pressure  distribution  sensor  array 
that  can  image  tactile  profile  of  lumps  [1],  The  primary  objective  aims  that  (1)  new 
tactile  mapping  technology  can  quantitatively  measure  the  location  and  applied 
forces  in  breast  palpation,  and  the  tactile  features  of  detected  breast  lumps;  and  (2) 
new  device  can  accurately  characterize  and  document  breast  lumps  and  will  improve 
clinicians’  ability  to  monitor  changes  in  lump  across  time  and  possibly  to  distinguish 
malignant  from  benign  lumps.  From  a  set  of  “images”  of  the  suspect  mass,  a  neural 
network  supported  pattern  analysis  system  will  extract  the  invariant  properties  of  the 
lump,  such  as  the  depth  and  size,  based  on  a  nonlinear  model  of  sensor-tissue 
interaction  with  hard  inclusions.  This  TMD  system  will  make  it  possible  for  the  first 
time  to  quantitatively  and  objectively  record  and  characterize  the  processes  and 
findings  of  breast  palpation.  While  initially  the  system  will  be  used  to  perform  clinical 
breast  examination,  we  believe  that  eventually  it  may  be  used  in  breast  self- 
examination  by  women  through  tele-home  care  [3-4]. 

2.  System  Overview 

The  goal  of  this  research  is  to  extend  the  range  and  resolution  of  breast  palpation 
methods,  thus  increasing  palpation  sensitivity  and  specificity  (i.e,  the  ability  to  detect 
lumps  and  distinguish  clinically  significant  changes).  Using  3-D  camera,  force  sensor, 
and  tactile  arrays,  we  can  create  reproducible  tactile  maps  of  the  palpable 
abnormalities  of  the  breast.  The  novel  3-D  camera  invented  by  the  Genex 
Technologies,  Inc.  is  able  to  provide  real-time  3-D  motion  measurement  (for  tactile 
probe)  and  surface  profile  measurement  (for  breast  tissue  deformation)  at  a  rate  of 
30  frames  per  second.  We  have  further  integrated  and  evaluated  related  state-of-the- 
art  sensing  technologies  including  tactile  sensor  array  and  six  DOF  force/torque 
sensor  to  extract  tactile  information  from  breast  palpation,  where  the  sensor-tissue 
interaction  of  detected  palpable  lesion  can  be  quantitatively  measured  and  displayed 
in  terms  of  tactile  images.  Our  laboratory  experiments  aimed  at  characterizing  the 
simuiated  tumors  in  breast  phantom  have  demonstrated  that  palpable  inclusions  can 
be  located  to  within  1  mm,  and  the  experiment  is  undergoing  for  pre-clinical 
evaluation  with  real  breast  tissues. 

Our  prototype  system  incorporates  a  3-D  Rainbow  camera,  a  tactile  sensor  array 
probe  (TSAP),  a  breast  model  with  simulated  lumps,  a  force/torque  sensor  on  which 
the  breast  model  is  mounted,  and  a  graphical  user  interface  (GUI).  Figure  1  shows  a 
block  diagram  of  the  tactile  mapping  device  system  to  be  used  for  measurement  of 
palpable  abnormalities  in  the  laboratory  and  later  in  pre-clinical  trial.  In  a  typical  task, 
upon  detecting  a  suspicious  lump,  the  examiner  will  bring  the  TSAP  into  contact  with 
the  tissue  at  the  palpation  site.  For  a  thorough  tactile  mapping  procedure,  this 
involves  3-D  positioning  the  probe  through  the  capnera  facing  the  site.  The  resulting 
pressure  distribution  across  the  probe  surface  is  measured  by  a  Tactile  Sensor  Array 
Probe  (TSAP)  with  associated  readout  electronics.  Multiple  tactile  images  with 
various  force  levels  and  torque  angles  will  be  required  for  the  lesion  characterization. 
A  computer  processes  the  signals  to  generate  appropriate  output  for  visual  display  on 
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a  monitor  or  raw  data  to  the  physician’s  office  through  a  telecommunication  channel. 
Below,  we  describe  the  components  of  the  tactile  mapping  system. 

/ 

2. 1  3-D  Rainbow  Camera 

For  the  accurate  positioning  of  the  TSAP,  a  novel  3-D  rainbow  camera  is  adopted  in 
our  system,  which  is  suitable  for  this  high-speed  3-D  machine  vision  application. 
Figure  2  shows  the  rainbow  camera  and  the  acquired  sample  range  image.  It  exploits 
a  color  light  projector  to  illuminate  the  object  in  the  scene  and  using  an  off-the-shelve 
color  camera  to  obtain  a  full-frame  color  image  of  the  scene.  The  color  of  the 
projecting  light  with  spatially  continuously  varying  wavelength  is  encoded  with 
information  of  the  corresponding  projection  angle.  Each  pixel  of  the  color  image  is 
associated  with  a  unique  ray  through  the  focal  pqint  of  the  camera.  Since  the  angle 
between  camera  axis  and  the  ray  is  known  the  resulting  angle-side-angle 
triangulation  problem  can  be  easily  solved  when  the  distance  between  the  light 
projector  and  the  camera  is  fixed.  Thus,  using  only  one  camera,  the  full  frames  of  3-D 
range  images  can  be  obtained  directly  at  the  camera  frame  rate  (60  frames/s).  The 
spatially  varying  wavelength  light  is  generated  by  a  white  light  passing  through  a 
linear  variable  wavelength  filter.  We  have  performed  experiments  to  investigate  the 
actual  range  accuracy  and  the  major  error  contributors.  The  results  show  that  the  3-D 
profile  of  test  artifacts  were  less  than  1  mm.  The  spatial  resolution  of  the  system  is 
limited  only  by  the  spatial  resolution  of  the  came/a  optical  sensing  element  and  is 
currently  able  to  provide  at  least  1024x1024  pixel  resolution.  When  a  palpation  site  is 
determined,  several  3-D  range  images  will  be  acquired  to  record  the  site  information. 


Visual  3D  Rainbow 


Figure!  System  block  diagram. 


Figure  2.  Three-dimensional  range  image  of  the  breast  model  by  the  Rainbow 
camera. 

2.2  Tactile  Sensor  Array  Probe  (TSAP) 

Figure  3  illustrates  the  operation  of  the  capacitive  tactile  array  sensor  used  in  this 
system.  It  shows  a  drawing  of  the  array  with  the  copper  layers  and  the  silicone  rubber 
spacers,  which  is  based  on  the  state-of-the-art  design  by  Fearing  [5]  and  Howe  [3]. 
The  array  is  composed  of  two  crossed  layers  of  copper  strips  separated  by  thin  strips 
of  silicone  rubber  [5],  Each  crossing  area  forms  a  capacitor,  and  when  a  force  is 
applied  onto  where  the  strips  cross,  the  distance  between  the  strips  decreases  and 
the  capacitance  increases  [6].  Specially  designed  electronics  will  measure  the 
capacitance  of  each  element  and  relate  the  capacitance  change  to  the  force  applied 
to  each  element.  By  measuring  the  capacitance  variations  from  all  the  elements 
simultaneously,  we  can  determine  the  spatial  distribution  of  pressure  across  the 
sensor  array.  Figure  4  shows  a  photograph  of  a  commercial  prototype  TSAP.  The 
sensor  array  is  made  with  an  inexpensive  photolithography  and  etching  process  and 
can  be  easily  attached  to  a  variety  of  probe  shapes.  In  this  prototype  specification,  it 
is  composed  of  an  eight  by  eight  tactile  sensor  with  elements  that  are  4  mm  on  a 
side.  The  sensor  is  mounted  on  a  plastic  brass  backing  plate  with  a  surface  that  has 
been  machined  into  a  section  of  a  square.  The  backing  plate  is  5.08  cm  on  a  side 
and  the  effective  sensing  area  is  3.20  cm  on  a  side.  We  decided  to  make  the  sensor 
flat  in  order  to  minimize  inhomogeneity  because  the  resulting  pressure  distribution 
should  have  a  uniform  overall  signal  to  noise  ratip.  The  tactile  images  will  then  be 
consistent  when  used  for  various  breast/chest  background  textures.  The  spatial 
resolution  of  the  tactile  array  is  4  mm  long  where  the  smallest  masses  that  we  are 
currently  interested  to  characterize  are  on  the  order  of  1  cm  in  diameter.  Smaller 
elements  would  increase  spatial  resolution  at  the  cost  of  lower  coverage  area  and 
low  sensitivity  since  the  capacitance  is  proportional  to  the  element  area  [6].  The 
tactile  sensor  has  been  shielded  to  provide  electronic  insulation. 


Figure  3.  A  drawing  of  a  tactile  array  sensing  (adapted  from  Son  1996). 
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2.3  Force/Torque  Sensing  System 

The  TMD  operation  requires  that  the  forces/torques  exerted  by  the  operator  of  the 
TSAP  on  the  breast  model  be  acquired.  It  would  be  ideal  If  a  force/torque  sensor 
were  to  be  mounted  between  the  wrist  and  the  hand  of  the  operator.  Since  it  is 
problematic  and  impractical  to  mount  a  force/torque  sensor  In  such  a  configuration, 
we  decided  to  mount  it  under  a  base  which  the  breast  model  is  placed  on.  The 
forces/torques  acquired  by  the  sensor  in  this  configuration  can  be  transformed  to 
those  exerted  by  the  operator  via  proper  coordinate  transformation.  Figure  5  shows  a 
breast  model  laying  on  a  round  base  under  which  a  force/torque  is  mounted.  The 
JR^  force/torque  mainly  consists  of  a  JR^  monolithic  six  DOF  force  sensor  and  a  JR^ 
Intelligent  Support  System,  Comprised  of  boards  for  signal  conditioning,  data 
acquisition  and  processing.  A  computer  program  was  written  in  Visual  to  request 
the  JR^  force/torque  sensing  system  to  send  to  the  computer  six  forces/torques  along 
about  the  Cartesian  x-,  y-,  z-axes  assigned  to  the  base.  The  transmitting  and 
receiving  of  data  between  the  computer  and  the  force/torque  system  is  carried  out 
through  serial  port. 


Figure  4.  A  commercial  prototype  tactile  array  sensor  probe. 


Figures.  JR^ Force/Torque  Sensor 


2.4  Breast  Models 

The  breast  models  used  in  our  laboratory  experiments  were  provided  by  the  HEALTH 
EDCO,  a  Division  of  WRS  Group,  Inc.  The  models  were  made  from  BIOLIKE™ 
synthetic  tissue  that  feels  just  like  a  real  breast  p].  Two  models  were  used  In  our 
tests  to  collect  preliminary  data.  Each  of  them  has  5  lumps  that  simulate  easy-  and 
hard-to-find  breast  tumors  with  various  sizes  and  depths  at  different  locations.  One  of 
the  models  is  the  geriatric  breast  that  is  ideally  shaped  to  address  the  special 
problems  of  older  women.  The  geriatric  model  simulates  the  natural  stretching  of  the 
tissue  with  age.  Figure  6  show  the  distribution  of  simulated  lumps  (lesions)  in  the 
breast  model  and  the  historical  spatial  distribution  of  the  breast  cancer  respectively.  It 
should  be  noticed  that  as  high  as  50%  of  breast  cancers  occur  at  the  axilia  area 
which  is  difficult  to  imaging. 


(6.a)  (6.b) 

Figure  6.  Breast  model  with  simulated  lumps  (lesions)  (6.a)  and  the  spatial 
distribution  of  the  locations  of  breast  cancer  occurrence  (6.b). 


2.5  Graphical  User  Interface 

Microsoft  Visual  C**  was  employed  to  implement  the  GUI  to  visually  display  pertinent 
data  of  the  TSAP  and  the  force/torque  sensor.  Figure  7a  shows  the  pressure 
distribution  acquired  by  the  TSAP  and  Figure  7b  the  time  response  of  the  six 
force/torques  applied  by  the  operator. 


(7.a)  (7.b) 

Figure  7.  Pressure  distribution  provided  by  the  TSAP  (7. a)  and  Time  response 
display  offerees  and  torques  (7.b). 
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3.  Experimental  Results 

In  order  to  demonstrate  the  effectiveness  of  the  TMD  system  for  the  characterization 
and  documentation  of  detected  lumps,  intensive  experiments  have  been  conducted 
to  pilot-test  the  sensitivity  and  reproducibility  of  the  system  in  measuring  the  applied 
forces  and  pressure  profiles  due  to  lumps.  The  primary  objective  here  is  to 
quantitatively  acquire  tactile  measurements  of  the  perceived  lesions  using  the  TMD 
system  and  to  evaluate  the  performance  of  the  system. 

During  the  experiments  conducted  below,  the  forces/torques  applied  by  the  human 
examiner  during  the  palpation  are  recorded  in  teijns  of  six  force  parameter  values, 
i.e.,  Fx,  Fy,  Fz,  Mx,  My,  Mz,  For  the  tactile  imaging  of  simulated  lesions,  the  TSAP  is 
used  to  acquire  various  tactile  images  by  palpating  the  site  after  the  examiner  locates 
the  lesion  by  initial  hand  palpation.  Since  the  relationships  between  the  tactile 
images  and  lesion  characteristics  are  expected  to  be  complex  and  nonlinear,  we 
believe  that  the  inverse  problem  (extraction  of  lesion  characteristics  from  tactile 
images)  can  be  solved  when  sufficient  tactile  information  is  acquired.  As  a  result,  for 
each  of  the  lesions,  after  pushing  the  TSAP  against  the  breast  to  achieve  certain 
level  of  force,  the  examiner  rotates  the  TSAP  to  five  different  orientations  at  each  of 
which  the  information  about  the  forces/torques  and  tactile  image  are  simultaneously 
recorded.  OR1  is  the  initial  orientation  of  the  fsAP  after  being  pushed  by  the 
examiner  to  certain  level  of  force.  OR2,  OR3,  OR4  and  OR5  are  the  TSAP 
orientations  after  it  is  rotated  forward,  backward,  left  and  right,  respectively. 

We  carry  out  the  above  procedure  on  two  different  lesions;  Lesion  1  and  Lesion  4  as 
identified  in  Figure  6. a.  Figure  9  shows  the  3D  mesh  surface  (Figure  9.a)  and  the 
shading  interpolation  (Figure  9.b)  of  the  pressure  distribution  measured  by  the  TSAP 


/ 


for  Lesion  1 ,  with  the  top  row  for  OR1  and  the  following  rows  for  OR2,  OR3,  OR4  and 
OR5.  Figure  10  shows  the  results  obtained  for  Lesion  4  presented  in  the  same 
manner  as  Figure  9. 


Figure  9.  Display  of  experimental  results  for  Lesion  1 . 
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(10.a)  (10.b) 


Figure  10.  Display  of  experimental  results  for  Lesion  4. 

The  values  of  forces/torques  for  the  experiments  conducted  for  Lesions  1  and  4  are 
tabulated  in  Table  1. 
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Lesion 

TSAP 

Orientation 

6DOF  Force  &  Torque  (Ib/inlb) 

Fx 

Fy 

Fz 

Mx 

My 

Mz 

1 

ORl 

-0.89 

0.44 

-0.13 

-2.58 

-10.80 

0.50 

OR2 

-2.34 

2.50 

-0.10 

-5.26 

-22.02 

1.59 

OR3 

1.69 

2.96 

-0.03 

-2.28 

-10.50 

3.57 

OR4 

3.20 

-0.38 

0.27 

0.40 

0.40 

2.09 

OR5 

-1.83 

0.38 

-0.03 

-2.38 

-9.32 

1.99 

4 

ORl 

-3.17 

1.77 

-0.16 

5.85 

25.59 

-0.89 

OR2 

-2.08 

2.48 

-0.22 

4.37 

18.35 

1.78 

OR3 

-8.81 

-0.03 

-0.09 

1.98 

10.71 

0.20 

OR4 

-3.67 

-1.72 

0.00 

2.18 

10.01 

0.39 

OR5 

-4.77 

4.02 

-0.34 

2.18 

ro.8i 

3.97 

Table  1 .  Results  force/torque  measurements  for  Lesions  1  and  4. 

Before  conducting  the  experiment  on  Lesion  1  and  Lesion  4,  we  apply  the  same 
procedure  on  a  location  at  which  there  exists  no  lesion.  The  resulting  display  shows 
no  peak.  Examining  the  graphical  displays  in  Figure  9  and  10  in  comparison  with  that 
of  the  case  of  no  lesion,  we  notice  that  a  peak  consistently  occurs  in  the  display.  We 
can  draw  a  preliminary  conclusion  here  that  a  peak  in  the  graphical  display  indicates 
the  existence  of  a  lesion. 

In  addition,  the  force  and  torque  that  we  recorded  in  conjunction  with  the  tactile 
sensing  during  palpation  can  give  us  the  information  about  the  contact  location  and 
how  much  force  that  we  apply  on  the  hard  lump  in  the  breast  model. 

4.  Discussion  and  Conclusion 

This  paper  has  concerned  with  the  detection  of  lumps  in  breast  palpation  using  a 
tactile  mapping  device  (TMD)  system.  It  presented  the  main  components  of  the  TMD 
and  explained  their  operations.  Experiments  were  conducted  on  a  breast  model  to 
detect  two  different  types  of  lumps.  Experimental-Tlata  showed  that  the  peak  in  the 
display  of  pressure  distribution  of  the  TMD  indicated  the  presence  of  a  lump.  With  the 
proven  power  of  nonlinear  signal  processing  using  both  convolution  neural  networks 
(CNN)  and  multi-layer  perceptron  (MLP),  we  expect  that  the  tactile  parameters 
associated  with  the  lesions  (i.e.,  the  size  and  depth  of  the  lesion)  can  be  estimated 
more  accurately  than  those  by  the  conventional  approaches  using  the  first  principle  of 
engineering  [6], 
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